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Abstract 
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\ A noisy CDMA downlink channel operating under a strict complexity con- 

straint on the receiver is introduced. According to this constraint, detected 
■ bits, obtained by performing hard decisions directly on the channel's matched 

filter output, must be the same as the transmitted binary inputs. This channel 
setting, allowing the use of the simplest receiver scheme, seems to be worth- 
less, making reliable communication at any rate impossible. However, recently 
this communication paradigm was shown to yield valuable information rates in 
the case of a noiseless channel. This finding calls for the investigation of this 
. attractive complexity-constrained transmission scheme for the more practical 

o 

On 
O . 

ly-) , states of the renowned Hopfield model, it is proved that under a bounded noise 
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noisy channel case. By adopting the statistical mechanics notion of metastable 



assumption such complexity-constrained CDMA channel gives rise to a non- 
trivial Shannon-theoretic capacity, rigorously analyzed and corroborated using 



^ ■ finite-size channel simulations. For unbounded noise the channel's outage ca- 

pacity is addressed and specifically described for the popular additive white 
Gaussian noise. 

Index Terms: Shannon Capacity, outage capacity, code-division multiple ac- 
cess (CDMA), downlink, low-complexity receiver, large-system analysis, statistical 
mechanics, Hopfield model. 
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1 Introduction 



Code-division multiple-access (CDMA) technology serves extensively in wireless com- 
munication systems. As such, revealing its information-theoretic properties has been 
a fruitful source of ongoing research (e.g., [1,2] and references therein). 

As in any problem of reliable (i.e. errorless) communication via a detrimental chan- 
nel, typical information-theoretic investigation of CDMA channels must be carried out 
under certain resource constraints. For instance, often an upper bounded transmission 
power or limited bandwidth are assumed, but usually no restrictions on complexity 
are imposed. 

However, in the era of pervasive and ubiquitous communications there is an emerg- 
ing interest in the workings of a stricter complexity-constrained scenario. According 
to this scenario, in the CDMA downlink detected bits, sliced at the output of the 
user's matched filter, must be the same as the transmitted binary inputs. Such a 
transmission constraint implies the appealing use of low-cost trivial receivers. Still, 
this channel setting seems at first to be worthless, making reliable communication at 
any rate impossible. 

Recently [3], we have computed the Shannon capacity of a noiseless complexity- 
constrained CDMA channel and found it to yield non-trivial capacity. In some cases, 
the capacity of the noiseless complexity-constrained channel was proved to be com- 
parable to the capacity of optimal multi-user receiver. Nevertheless, formerly there 
has been no rigorous examination of the information-theoretic characteristics of the 
more practical noisy CDMA channels under this strict user complexity-constrained 
setting. 

In this paper, we extend our previous work [3] and compute the capacity of a 
noisy CDMA downlink with trivial mobile receivers. For this purpose, we borrow 
analysis tools from equilibrium statistical mechanics, especially the Hopfield model 
of neural networks [4,5]. Note that although the Hopfield model has been utilized 
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in previous works for developing sub-optimal multi-user detectors [6-8], this contri- 
bution (along with [3]) is the first attempt to exploit the metastable states structure 
of the Hopfield model for Shannon-theoretic investigation of CDMA and communi- 
cation channels in general. By borrowing this statistical mechanics notion, valuable 
achievable information rates are unveiled. 

The paper is organized as follows. Section El introduces the noisy complexity- 
constrained CDMA channel model, while section El derives rigorously its asymptotic 
capacity. Section |U provides and discusses the devised analytical capacity curves, 
being validated via finite-size simulations. We conclude in section El 

We shall use the following notations. The operator /'(•) denotes a derivative of 
/(•) with respect to (w.r.t.) its argument, while < • > x denotes the average w.r.t. 
x, and S(-) is the Dirac delta function. The symbols j = \/— 1, lo is the angular 
frequency of the Fourier transform, while ^ x and Yli^k correspond to a sum over all 
the possible values of x and a non-overlapping summation, respectively. Finally, an 
error function is defined by Q(x) = \j\p2m dyexp (—y 2 /2). 

2 Channel Model 

Consider a noisy synchronous CDMA downlink (depicted in Fig. [Q) accessing K active 
users via the mutual channel in order to transmit their designated (coded) information 
binary symbols, x^ = ±1, where k = 1, . . . , K, with equal power P. Each transmission 
to a user is assigned with a binary signature sequence (spreading code) of N chips, 
< = ±l,/i = l...iV. 

Assuming a random spreading model, the binary chips are independently equiprob- 
ably chosen, and the deterministic chip waveform has unit energy. The cross-correlation 
between users' transmissions is pki — l/N s k s i ■ 

The received signal is passed through the user's matched filter (MF). Thus, the 
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overall downlink channel is described by 



y k = \[Px k + y/P^pkiXj + n k , (1) 

where the fc'th user matched filter output, y k , is the designated bit, x k , corrupted by 
interference and noise terms. The interference term is composed of a summation over 
cross-correlation scaled versions of all other users' bits. The set of all cross-correlations 
{pki} is hereinafter denoted by p. The noise term is assumed to be independent and 
identically distributed (i.i.d.) and symmetrically bounded, i.e. — ka/P < n k < KyP, 
where the threshold k is a known non-negative constant. In the following asymptotic 
analysis, we assume that K — > oo, yet the system load factor (3 = K/N = a -1 is kept 
constant, and that the information rate is the same for all users, i.e. R k = R- 
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Figure 1: Discrete-time schematic of the complexity-constrained CDMA downlink. 



We want to convey information reliably through the channel (JTJ under a low- 
complexity constraint on the user receiver. According to this constraint, detected 
bits, x k , obtained by performing hard decisions directly on the single-user matched 
filter output samples, must be the same as the transmitted bits. Explicitly, 

x k = %k = Sign(y k ), (2) 
where Sign(-) is the trivial sign function. 
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For any Xk and yk which 
scalar for which 



maintain the constraint (J2J), there is a certain positive 
XkVk = A fc > 0. (3) 



Moreover, the bounded noise assumption yields that 



x k (x k + ^2pki%i)) > «, 



(4) 



i^k 



or alternatively 




(5) 



i^k 



It is important to notice that due to the trivial receiver scheme adopted, and 
especially its non-linear sign operation, the Shannon capacity becomes invariant in 
the exact noise probability distribution function, but it only depends on the noise 



regardless of its exact probability distribution function form, suffices. 

Under the constraints outlined above it is clear that not all combinations of input 
symbols will result in errorless communication. Thus, the capacity of the channel can 
be obtained by evaluating the number of codewords that ensure errorless detection. 
The codewords constraint (jHJ) is analogous to the constraint on the single-neuron (or 
spin) flip metastable states of the Hopfield model. In the following section we prove 

that this complexity-constrained CDMA channel setting yields non-trivial capacity. 

1 In the case of unbounded noise, e.g. additive white Gaussian noise (AWGN), the following 
analysis still holds, but the term of Shannon capacity should be replaced with the term of outage 
capacity. This issue is addressed in section 



upper and lower values 




This explains why the bounded noise definition, 
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3 Asymptotic Capacity 



A binary codeword x c = {xl, . . . , x c K }, composed of all K users' bits at a given channel 
use, for which the channel constraints (JHJ) hold, satisfies the condition 



Condition (jH} can be reformulated as 



poo K 

/ n d ^ s (^2 pkiXi ~ = i - 
j*- 1 k=i 



(6) 



a Y\_dX k 5(^2ap k iXi - a\ k x k ) (7) 
k =i i^k 

Y\ dX k 5(^ap k iXi - \ k x k ) = 1. 

k=1 ^ k 



Let the random variable N(K,/3,p, k) denote the number of codewords, i.e. 

- AfcX fe ). (8) 

Assuming equal user information rates, the corresponding asymptotic capacity of the 
channel is defined [91, in bit information units, as 



n ,a \ a y log 2 N(i^, (3, p, k) . . 

Coo(P,K) = j lm 77 • (9) 

A -^oo J\ 



Assuming self-averaging property [2,10], in the large-system limit K —>■ oo the number 
of successful codewords N(K, (3, p, k) is equal to its expectation w.r.t. the distribution 
of p, i.e. 



lim N(K,P,p,K) =M(P,k) 

K—>oo 



lim 

K— >oo 



/ n d ^ ^2 { n ^ ( 5Z a P kiXi ~ ^ k%k ) ) ' ( io ) 



i^k 

where J\f(@, k) denotes the average. 
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Representing the delta function by the inverse Fourier transform of an exponent, 
expression ([10)1 can be rewritten as 



poo i poo 

^ exp (j ^ Vk^kXk) I exp ( - j ^ apuXiUJ^j \ . (11) 



x 



Substituting x k oj k for u k , we find 



poo i /*oo 

x exp (j ^fcA fc ) ■ E, (12) 



where 



E = ^ exp ^ - j ^ ap k iXiX k uj k ^ 

i^k i p 

1 N \ 

exp ( - j Y x Y s%s?XiX k u k M . (13) 



The expectation E can be also written as 



E = exp(jaJ2u k )( exp (- ^Y1^2 s k XhUJk )(^2 s k x k) )) 

k \ \i k k I , 



Using the transformation [11] 



(14) 



«p<-,w> = £i£i (15) 

x exp (j — (aj - 6j) - ;-y=A*K + M - Ty^K ~ b ^J > 
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expression (fTlj) becomes (here, and hereafter, logarithms are taken to base e) 

db,, 



X 



exp (/y ~~ 6 ^ + log ( cos ( c ^))J > (16) 

where 

Cfc, M = -j= (uj k (a^ + + (a M - (17) 

Since Ylik s k x k m is 0(yK) for a vast majority of codewords, for the expec- 
tation E to be finite, a M and must be 0(1/\^K). Hence, expanding the log ( cos(-)) 
term in exponent |T6|) and neglecting terms of order 1/K and higher, we get 



x exp (j— J2( a l~ b l) ~ \j2 d ^ r 

k,fj, 



db^ 



where 



c Kil 4 (ooKa^ + brf + 2u k (al - b\) + (a„ - 6„) 2 ). (19) 



Now, the solution of the 7^- dimensional integral ()18j) of the expectation E is 
performed using the following mathematical recipe: New variables are introduced 



A 

a = 

2a 
t 1 



l -Y,i^ + Kf, (20) 



2a 

t 1 



Equations (J2U)) and (j?!)) can be reformulated via the integral representation of a delta 
function using the corresponding angular frequencies A and B, respectively, 

/°° dadA , (a,, + 6,,) 2 n n 



r dbdB ( ' k"r( h ■rWlS 1 
j^^Ka-^^^-^— <*» = (23) 



Substituting these (unity) integrals into the expectation expression (fT8j) and rewrit- 
ing it using a and b, the integrations over a M and are decoupled and can be per- 
formed easily. Next, for the asymptotics K — > oo, the integration over the frequencies 
A and B can be performed algebraically by the saddle-point method [10]. 

According to this method, the main contribution to the integral comes from values 
of A and B in the vicinity of the maximum of the exponent's argument. Finally, the 
E term boils down to 



E 



/°° da db , 1 x -» 2 x -» . 

x ^{Kaib-^ + ^^ + Uoga)). (24) 



Substituting the expectation term back in (JT2J), the integrand in the latter 
becomes independent of x, and therefore the can be substituted by multiplying 
with the scalar 2 K . Hence, 



poo ^ /*oo , 

H{f3,K) = lim / \\ d ^k— I \\ dcj k exp ( j u k X k 
f°° dadb / , 1 (1-b) 2 1, N \ 

x exp ( - ^aa^ul + jab^u^, (25) 

k k 

where the resulting to dependent integrand is a Gaussian function. Thus, performing 
Gaussian integration and exploiting the symmetry in the X-dimensional space, we 
get 



Kfla \ 1 dadb ( v fu 1 (!- & ) X i \' 

x expfW^T dAexp(-^±^))\ (26) 
V V V aa 7 a ( re _i) 2aa 'J J 
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Using the rescaling (ab + \)/y/aa — > A, the integral (J26|) becomes 

N{P, k) = lim / -p^- exp (Kg(a, 6, /?,«)), (27) 
where the function #(a, 6, /3, «) is defined by 

g(a, b, 0, k) 4 I (6 - ~ + + i log a) + log (2Q(t)) , (28) 



with an auxiliary variable 

A 



t + (29) 



Again, for K — > oo, the double integral in (|27ji can be evaluated by the saddle- 
point method. Hence, we find 2 

J\f(p,K)<x lim exp (Kg(a*,b*,/3,K)), (30) 

if— >oo 

where a* and 6* are found by the saddle-point conditions, which yield the following 
equations 

»'- ftt| = r .(<i^-l) +i ^l=0, (31) 
da v a ' Q(t) 

dg(a,b,P, k) _ w 1-6 ^ 1 Q'(t) 

96 - ^ i 1 — ; + ^ g(t) - u - ^ 

One then finds that this set of equations is satisfied by 

b* = 0, (33) 

* - ^i^^Wi^ (34) 

where 

t*±(K-l)/y/d*j3. (35) 



2 The exponent pre-factor in i|30|l is not required for computing the asymptotic capacity, and 
therefore it is omitted. 
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This saddle-point condition's fixed-point a* can be found iteratively, and it always 
converges in the examined model [5]. 

Finally, substituting (jHU|) into the asymptotic capacity, in nat per symbol per 
user, is now easily obtained 

CM k) = g(a\ b*,(3, K ) = log (2Q(t* )) + 1 (_L + i logo* - i), (36) 

which forms our pivotal result. In section 0] we further discuss the theoretical results 
and compare them with computer simulations of the complexity-constrained CDMA 
channel. 

4 Results and Discussion 

Fig. El displays the asymptotic capacity (pffij) . obtained by solving iteratively the 
saddle-point condition (|34|) . as a function of the load (5 in various noise levels. Inter- 
estingly, in noiseless channel (k = 0) for small (3 < 0.1 values the trivial 1 bit upper 
bound (of an optimal receiver, i.e. matrix inversion) is practically achieved by this 
simple hard decision operation. 

Furthermore, for higher system load such a complexity-constrained CDMA setting 
still yields substantial achievable information rates. Note, in passing, that for heavily 
overloaded system (i.e. (3 — > oo) the capacity curve decay of the noiseless case coincides 
with Hopfield model's capacity (see [4, eq. (12)] for an analytical approximation of 
this capacity decay to zero.) Even in the presence of noise non-negligible rates are 
obtained for the examined noise levels (up to k — 1) in a wide range of load values. 

In order to validate the analytically derived asymptotic capacity Coo(/3, k), we 
evaluated the capacity Ck{/3, k) of a noisy CDMA downlink channel with large, yet 
finite number of users K, using exhaustive search simulations. The number of suc- 
cessful binary codewords, maintaining the channel constraints (JHJ), was obtained by 
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0.01 0.1 1 

Load (3 

Figure 2: Asymptotic capacity (solid line), in terms of bit/symbol/user, as a 
function of load (3 in various noise levels k = 0,0.5,0.75,0.9,1. Also drawn is the 
finite-size simulation-averaged capacity Ck for K = 25 (empty squares). Vertical 
bars stand for standard deviation in simulation results. 

examining all 2 K possible codewords. The average logarithm of the counted number, 
normalized by the number of users K, gives the capacity Ck- 

Fig. |21 presents the capacity obtained by simulations for K = 25. As can be 
seen, the empirical capacity for finite K deviates only slightly from the analytically 
obtained asymptotic capacity. Due to finite-size effects these slight deviations from 
theoretical results grow with the decrease in the capacity. These results substantiate 
the analysis of the complexity-constrained CDMA channel. 

The devised capacity is also drawn in a reciprocal manner. Fig. El displays C^ as a 
function of the noise threshold k, this time for a fixed load (3. The capacity decreases 
monotonically as a function of k from asymptotically 1 bit down to zero capacity. 

Three typical regimes can be readily observed: As may be expected, for noise 
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Figure 3: Asymptotic capacity C^, in terms of bit /symbol /user, as a function of 
noise levels k for a fixed load (3 = 0.01 (solid line), 0.1 (dashed), 1 (dashdotted) . 

thresholds k < 1, an increase in system load (3 directly results in lower capacity. 
On the other hand, for thresholds k > 1, as the system becomes more loaded, the 
maximum achievable rate increases, and the interfering users play a constructive, 
rather than destructive role. 

This fascinating phenomenon can be explained by the fact that when the noise 
becomes more dominant (i.e. at the order of information power P), a certain user's 
designated information bit can not exceed the transmission constraint by itself and 
needs the assistance of the "interference" term (organized properly) in order to deliver 
its own information reliably. 

For (3 = 0.01, 0.1 and 1 zero capacity is found to be inevitable starting from noise 
thresholds as 1.05, 1.09 and 1.27, respectively, for which reliable communication in 
this complexity-constrained setting becomes infeasible. The transition between these 
two regimes occurs at the vicinity of k — 1, for which the capacity is approximately 
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0.2 bit, regardless of the examined system load (as can be seen more clearly from 
Fig. El) 



4.1 AWGN and Outage Capacity 

Evidently, for unbounded noise distribution, like the popular additive white Gaussian 
noise (AWGN), Shannon capacity, under the examined complexity constraint, is zero. 
However, the analysis is still useful for obtaining the outage capacity instead of the 
Shannon capacity. 




10 1 1 1 

0.2 0.4 0.6 0.8 1 

Outage Capacity [Bit/Symbol/User] 

Figure 4: Outage capacity for AWGN: bit error rate per user P& as a function of the 
rate, in terms of bit /symbol/user, for various E b /N levels ((3 = 0.1). 

Fig. 0] presents the bit error rate (BER) per user P& as a function of the corre- 
sponding outage capacity, in terms of bit /symbol /user, for different signal-to- noise 
ratios in the case of AWGN. The BER is evaluated by computing the probability 
Pr(rifc > k^/P), and then it is linked to a certain achievable information rate via the 
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analytically derived capacity-threshold dependency (e.g. the curves in Fig. EJ). It can 
be seen that reasonable information rates can be achieved. 

For instance, for E b /N = lOdB a BER of 0.001 (which is the BER typically 
required for voice traffic) can be reached with a rate of 0.75 bit. For comparison, 
without any complexity constraint the Shannon capacity for binary-input AWGN 
CDMA is asymptotically 1 bit [2]. However, in order to approach this capacity an 
optimal multiuser receiver with intractable complexity of 0(2 K ) is required, along 
with a sophisticated decoding mechanism, while at the cost of 0.25 bit the proposed 
trivial receiver will do (for voice traffic). 

5 Conclusion 

We evaluated the asymptotic capacity of a noisy CDMA downlink channel model 
requiring only minimal signal processing at the receiver, thus suitable for networks 
with low-complexity mobile equipment. Interestingly, we found a range of non-trivial 
achievable rates. 

According to these findings, at a given channel use a fraction of the users, equal to 
Coo (i n bit), can receive its designated information with rate 1, while the transmissions 
to the rest of the users ensure reliable communication. Determining these redundant 
transmissions in a diagrammatic manner (rather than via brute-force enumeration, 
which becomes infeasible for large K) remains an interesting open research question. 
Also, the method used can be employed in the investigation of other (non-CDMA) 
noisy complexity-constrained channels. 
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